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Abstract 

Over the last decade, the hght microscope has become increasingly useful as a quan- 
titative tool for studying colloidal systems. The ability to obtain particle coordinates 
in bulk samples from micrographs is particularly appealing. In this paper we review 
and extend methods for optimal image formation of colloidal samples, which is vi- 
tal for particle coordinates of the highest accuracy, and for extracting the most 
reliable coordinates from these images. We discuss in depth the accuracy of the 
coordinates, which is sensitive to the details of the colloidal system and the imaging 
system. Moreover, this accuracy can vary between particles, particularly in dense 
systems. We introduce a previously unreported error estimate and use it to develop 
an iterative method for finding particle coordinates. This individual-particle accu- 
racy assessment also allows comparison between particle locations obtained from 
different experiments. Though aimed primarily at confocal microscopy studies of 
colloidal systems, the methods outlined here should transfer readily to many other 
feature extraction problems, especially where features may overlap one another. 
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1 Introduction 

Confocal microscopy lias made an enormous impression on the biological sci- 
ences [1], and started to do the same in colloidal science. In particular, the 
ability to perform a quantitative analysis, especially to extract particle coor- 
dinates from genuinely bulk colloidal samples, is hugely useful in providing 
information at the single particle level, and is ideal for comparison with the 
results of computer simulations. Whilst the range of experimental avenues 
to be explored is vast, several themes have emerged. Paradoxically, arguably 
more difficult systems such as glasses and gels have been studied in detail, as 
we discuss below. This is partly because of present outstanding questions in 
these which are likely only to be answered with knowledge of localised events, 
which more traditional 'averaging' techniques such as light scattering cannot 
easily access, but also because more tightly confined systems move at rates 
better suited, i.e. more slowly, to the more sedate hardware available until 
very recently. 

Amongst the very early studies of colloidal samples was a structural analysis 
of a very high density glass [2]. This lead to studies of (particularly heteroge- 
neous) dynamics in supercooled liquids and glasses [3,4,5,6,7]. Similar studies 
concentrated on aging [8,9,10,11] and the response of samples to localised 
perturbation [12]. Recently, in response to the experimental verification by 
light scattering of a re-entrant glass transition [13], the effect of an increasing 
short-range particle attraction on the glass transition has been studied [14]. 
In a similar fashion but for different attractions, other groups have studied 
gels [15,16,17,18,19,20,21]. 

As well as disordered systems, there have been studies of bulk crystals in sys- 
tems with both hard sphere [22] and more complex interactions [23,24,25,26], 
as well as crystallisation [27,28], stacking disorders [29], and growth (including 
epitaxial) of crystals [30,31,32,33]. Though many of these take advantage of 
the particle coordinates for structural and dynamic analyses, it is also possible 
to infer thermodynamic properties directly by microscopy [34]. 
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Recently, interest has developed in the behaviour of glasses under shear [35,36] 
and flow [37]. Studies such as these beneflt enormously from the advent of 
video-rate and faster confocal microscopes. At the other temporal extreme, 
studies on force distributions in emulsions [38,39,40] and sedimenting nearly- 
colloidal systems [41,42], in which particles are forced into intimate contact, 
present equal challenges. 

Several papers have described microscopy of colloids, both for video and con- 
focal microscopy (reviewed in [43] and [44] respectively) . The introductions by 
Weeks ([45], and latterly [46]) are accessible general references. The standard 
reference for quantitative studies, i.e. particle location and tracking, [47], is es- 
sentially for two dimensional studies using video microscopy. Others extended 
these to three dimensional confocal microscopy [48,49,50]. Some details of the 
other groups' techniques have emerged [23,51] and an excellent reference is 
web-based [52]. 

The above examples encompass a huge range of typical particle types, configu- 
rations, and imaging conditions. Key parameters which vary widely include the 
volume fraction (ranging at least from $=0,002 to $~0.64 [24,41]); particle 
size; typical particle separation (very different for gels and attractive glasses 
from that for coexistence crystals, even at the same volume fraction); sample 
composition (especially refractive index mismatch); the nature of the particles 
themselves (particularly whether the whole particle is visible to the imaging 
system); and the speed at which images can be captured. All of these affect the 
success of particle location, but these issues are not thoroughly considered in 
many papers. We emphasise particularly that studies which claim structural 
differences between different systems (e.g. [7]) should justify that the particle 
location works equally well in both systems. 

Our aim is for reliable and optimum coordinates. By optimum we mean both 
that the coordinates extracted from a given data set are the best that can 
be inferred from that data set, and that the data set contains the greatest 
possible information about the sample. Crucial to optimum coordinates is 
therefore optimum image capture, and optimum coordinate extraction, both 
of which we discuss here. Rehable refers to the fact that we have confidence 
— that is, an objective quantification — in each coordinate measured. Also in 
this paper, we introduce a means of comparing accuracy between data sets of 
differing quality; this is a measure of reliability. With this, we are able to obtain 
particle coordinates in difficult (what is meant by 'difficult' will become clear) 
samples, where, although the accuracy is necessarily low, we can nonetheless 
reliably locate the particles. Crucially, we argue that if meaningful quantitative 
comparisons are to be made between different systems, it is vital that such a 
measure is available. Quantitative confocal microscopy of colloids works well 
under favourable conditions (see the above citations), and we describe here 
how one can know how successful it has been. 
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Although we are interested in colloidal systems, we note that much of what we 
discuss has been considered in other fields. Some prominent examples are par- 
ticle image velocimetry (PIV), biophysics and astronomy. PIV does not quite 
track particles, but it seeks the location of correlation peaks using techniques 
similar to ours [53]. In biophysics, tracking of fluorescently dyed objects, for 
example proteins and lipids, as they diffuse on cell surfaces is a common prob- 
lem [54,55,56] and astronomers have developed many advanced algorithms, in 
particular for detecting x-ray sources, for example [57,58]. There is inevitable 
overlap between these fields, since they all seek to locate features with max- 
imum precision. Doubtless there is scope for further consolidation between 
these fields, but equally there is a strong motivation for discussing the partic- 
ular requirements of colloidal particle location in the microscope. Nonetheless, 
the contents of this paper should apply outside of colloidal science, and in par- 
ticular need not be limited to confocal studies; many bright features can be 
located using the techniques we describe. 

This paper covers the whole process of particle location, from the imaging of 
objects in the colloidal regime, to testing the validity of the extracted coordi- 
nates. In section 2 we discuss imaging of colloid-sized objects. We elaborate 
in section 3 on practical confocal microscopy of colloidal systems. Section 4 
discusses strategies for coordinate extraction, and Section 5 describes some 
basic tests of accuracy. Section 6 discusses the centroiding technique in some 
detail. Thereafter, in Section 7, we describe our improvements on this method, 
including a detailed error analysis, its success, and limitations. 



2 Imaging Colloid-sized objects 

In this Section, we describe the confocal micrograph of a spherical colloid- 
sized object, which is subtly distorted by the imaging system. The distortion 
is an inherent feature of imaging objects near to the diffraction limit of any 
imaging system. Its nature is important when attempting to locate objects 
in the colloidal size range, particularly in dense systems. For spheres, the 
micrograph which the imaging system produces is the sphere spread function 
(SSF). It will be described in detail, as will noise, which must be carefully 
dealt with to obtain optimum coordinates. 

2.1 Imaging Process 

Figure 1 shows the generic imaging process: visible electromagnetic radiation 
emanating from the object is represented by o{x, y, z), whilst f{x', y', z') is the 
image. The operation which transforms one into the other is performed by the 
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imaging system and is designated T[ ]: 
f{x',y',z') = T[o{x,y,z)]. 



An extended object o{x, y, z) can be considered a series of points on a finely- 
spaced lattice. An arbitrary point {i,j,k) in this lattice is specified by the 
delta function 5{i—x,j—y, k—z), allowing the object to be rewritten in terms 
of these lattice coordinates: 

o{i,j,k)= / / o{x,y,z)6{i-x,j-y,k-z)dxdydz, 



and where the integrals are over the field of view. This is a null operation, but 
permits us to proceed. The imaging process T[] can be written as a convolution, 
a description which is useful since both digital filtering and modelling the 
image of a spherical colloidal particle are performed in these terms. Now, an 
image is given by f{x', y', z') = T[o{x, y, z)], since the coordinate system used 
to describe the object cannot be important, so that: 



f{x',y',z')=T 



o{x, y, z)S{x'—x, y'—y, z'—z)dxdydz 



which, provided the imaging operation T[ ] is linear, reduces to: 

fW,y',z')= / / o{x,y,z)T[6{x'-x,y'-y,z'-z)]dxdydz. (1) 



From this wc identify the distribution T[d{x'—x, y'—y, z'—z)]=p{x, y, z) as the 
image of a single point, which in any real imaging system is not itself a single 
point; it is the point spread function (PSF) whose origin is the diffraction 
limit of the imaging system, and which is widely described in standard texts, 
for example [59] . 

The expression for the observed intensity, f{x', y', z'), is a convolution integral; 
f{x\ y', z') is the convolution of the system PSF with the object illuminance, 
which can be written as 

f{x', y', z') = T[6{x'-x, y'-y, z'-z)] o{x, y, z) = p{x, y, z) o{x, y, z), (2) 



where '0' denotes convolution. 

The image produced by an imaging system with linear T is simply the convo- 
lution of the effect that it has on a single point object with the original image; 
the imaging system places a copy of the point spread function at each point 
in the image, scaled by the intensity of the object at the corresponding point. 
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It is well documented that the PSF for the light microscope is well modelled 
by a Gaussian in both the lateral and axial directions (e.g. [41,59,60,61]). 
Also for other imaging systems it is possible to model accurately the PSF, 
and there are commercial software packages which can do this (for exam- 
ple, Huygens and Autoquant, http: //www.svi.nl/products/professional/| and 
http://www.aqi.com/index.asp respectively). Alternatively, one could mea- 



sure the response of sub-microscopic, essentially 'point' objects, many times to 
obtain a convincing (mean) system PSF. However, for our purposes, since the 
first peak in the PSF contains overwhelmingly the majority of the intensity of 
the distribution, and since the central peak is well modelled by Gaussians, the 
system PSF can be modelled by a simple set of Gaussians placed in a single 
array. 



i{x,y,z) = ioexp[-^ [(x-xq)^ + (y-yo) 



1 



[z-zo) 



populated the array in one calculation, and allowed the relative lateral and 
axial extents to be varied. The extent (the variance, c^=|) of the PSF was 
adjusted via ki and k2, to correspond to reasonable values for the confocal 
microscope. 



2.2 Imaging a Colloid-sized Object 



Every imaging system distorts the object by the PSF. In the worst cases, this 
renders the object unresolvable. In contrast, if the objects under study are 
much larger than the resolution limit, the distortions are not noticed (pho- 
tographs, television images). In imaging colloids, we investigate an intermedi- 
ate situation where diffraction effects are important but not overwhelming. 

Following the discussion above, we recognise the sphere spread function (SSF) 
as the convolution of true sphere response, isphere{x, y, z), with the appropriate 
PSF: 

SmodeK^;, y, Z) = isphereix, y, z) p(x, z) (3) 



We describe a simple model of this process for an indication of the resultant 
SSF. We will use this to justify our particle location technique. In partic- 
ular, we consider an approximation to the fluorescence confocal image of a 
homogeneously-dyed spherical colloidal particle. (The scattering of light from 
a dielectric sphere is more complicated [62] and does usually not give rise 
to a uniform intensity over the sphere, but this is beyond the scope of the 
present article.) We convolve its 'true' image isphereix,y, z) with the PSF of 
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the imaging system, p{x,y,z), (Equation 3 and Figure 2). Intensity distribu- 
tions through the resuhant modelled SSF compare well with confocal images 
of homogeneously-dyed PMMA particles. For more details, consult [41]. 

The PSF of a point particle is well modelled by a Gaussian surface of revo- 
lution. This is not necessarily the case for larger particles and thus suggests 
that a Gaussian docs not always model the SSF; its success is likely to vary 
with the size of the spheres. Although a Gaussian approximation does account 
for the important properties quite well (the shape is roughly right, and it is 
spherically symmetric) [47], it has been pointed out recently that the lobes 
can have an important effect on the inferred particle locations [63] . 

Even with our simple Gaussian approximation, we see the important feature: 
the 'smearing' of a micron sized sphere due to the diffraction limit results in an 
SSF that is larger in extent than the true size of the sphere. In the case where 
the spheres are well separated, this is of no consequence. However, when the 
spheres are close to one another, the SSFs overlap, a detail which turns out 
to be crucial in microscopy of some colloidal samples, and which we discuss in 
detail later. 

We argued above that the image of a particle can be written as a convolution 
of its illuminance i{x, y, z) with the imaging system PSF p(x, y, z), equation 3. 
In a similar way, we can view the placement of this image at any particular 
point in space (i.e. the particle coordinate) as a convolution with a Dirac delta 
function at that point. 

f{x\y\z')^5{v)Qs{x,y,z), (4) 



where s{x, y, z) represents the sphere spread function (modelled, such as SmodeK^^, Vi ^) 
above, or measured) which corresponds to a sphere centred on the origin 
(thereby defining implicitly an origin). 

By the convolution theorem, we can write this as 

F{u,v,w)^T{5{v)}xS^aS, (5) 

where F{u,v,w) is the Fourier Transform of the image f{x',y',z'), S is that 
of the SSF s{x,y,z) and J-'{S{r)} is that of a delta function at the particle's 
position r. The last equality follows since the Fourier transform of a delta 
function centred on the origin is simply a constant {— l/\/27r or 1, depending 
on the definition), J^{S{r)} = a. This idea of the image of a particle as an 
instance of a motif will be useful later. 

The intensity profile through a typical modelled SSF in lateral (left) and axial 
(right) direction are shown in figure 3. This SSF represents a sphere with a 
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diameter of 2 /xm and was calculated using a Gaussian PSF of lateral extent 
300 nm and axial extent 600 nm. The centroid of the brightness within a 
window about the particle corresponds to the centre of the particle (within 
uncertainty) . 

We have seen that the image of an object is its true form convolved with the 
instrument resolution function (the PSF), and how this affects the optical mi- 
crograph of a colloidal particle. The degree of broadening is purely a function 
of the system PSF, so one readily appreciates that the PSF would ideally be 
itself a point. Though diffraction means that this is never true, it can be made 
more nearly so. One widely used means of narrowing the PSF is the laser 
scanning confocal microscope (LSCM), which we consider now. 



2.3 Confocal Microscopy of Colloid-sized Objects 



Instrumental (PSF) related 'smearing' always hampers imaging colloid-sized 
objects with the light microscope, but is particularly compromising for bulk 
samples. There have been successful bulk colloidal studies using a conventional 
optical microscope [60,64,65,66], but the large extent (particularly axially) 
of the PSF is problematic. The confocal microscope addresses this difficulty 
particularly well. 

Figure 4 shows a simple representation of the confocal principle (for technical 
details see, e.g. [1,41,45,46,61]). The two sets of rays illustrate imaging of a 
point at the focal plane (solid black) and one outwith the focal plane (dashed 
red). Both are brought to focus at different points; light originating from 
outwith the object focal plane appears in the detected image as out-of- focus 
blur. The image is substantially improved by eliminating this by inserting 
an aperture at the detector (illustrated); the image plane is conjugate with 
the focal plane, hence confocal. The pinhole size is a compromise between 
the greater confocal effect of a small pinhole and the reduced light budget 
this affords. Due to the difficulty of manufacturing small variable apertures 
the pinhole size is not usually continuously variable. A near-match is usually 
more than satisfactory. The confocal aperture reduces the axial extent of the 
PSF, and whilst this is its most dramatic influence, it also diminishes the 
PSF lateral extent [41,61]. The confocal microscope is thus able to provide 
finely resolved images from within a bulk sample: this optical sectioning is 
overwhelmingly the most important benefit of the confocal microscope for 
colloidal studies. This improvement in resolution is at the expense of its field 
of view, which can subsequently be recovered by scanning [67]. 
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2.4 Noise 



So far we have assumed that the detector accurately reproduces the response 
of the object under study. In a real experiment, however, there is also noise, 
an all-inclusive term for processes which affect the image but which do not 
relate to the object itself. Examples include the discrete nature of the radia- 
tion; varying detector sensitivity; unstable illumination; electrical noise; and 
transmission errors. 

The signal-to-noise ratio (SNR) of an image is a means of quantifying 
the extent of noise-derived degradation [68]. No one measure of SNR fully 
quantifies the 'quality' of an image; most image processing addresses images 
which are ultimately for (inherently subjective) human observation. We give 
one definition of SNR: 

If the detected image g{i,j, k) comprises a 'signal' part f{i,j, k) and a 'noise' 
part n{i,j, k): 

9{iJ,k) = f{i,j,k) +n{i,j,k) (6) 

then the respective variances are = {\fii,j,k) — {f{i,j,k))\'^) and cr^ = 
(|n(i,j, The SNR is simply defined as: 



SNR = ^ = 

where the second equality follows since the noise in this case is uncorrelated: 

To find the SNR, therefore, we require two oi amCFfTCFg- From a single image, 
we only know ag. Occasionally, it is possible to extract a region of constant 
intensity (a region of sky within a photograph) and from this infer (7„. Gener- 
ally, and particularly in colloidal samples, this is not so, and we must obtain 
two images {gi{i,j,k) and g2{i,j,k)) of the same scene f{i,j,k): 




9i {i, j, k) = fii, j, k) +ni{i, j, k) 
92{i,j,k) = f{i,j,k)+ 712 {i,j,k). 

Taking the normalised correlation between the two realisations gi{i,j, k) and 
92{i,j, k): 

^ {{9i92-{9i){92))) ^ crj 

[{\9i-{9iW){\92-{92wf' ^/+^r 
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This permits direct calculation of the SNR 

SNR= J^^. 
V 1 — r 

With colloidal samples it is, however, seldom possible to form two successive 
images of the identical image, so that the SNR can rarely be calculated for a 
genuinely representative sample. 

Although the SNR is not definitive, we have found that an experienced eye is 
satisfactory in determining pre-analysis whether images are suitable. This is 
not crucial, since — with the aid of the analysis described in this paper — we 
assess the accuracy of individual coordinates post-processing. 



3 Imaging Bulk Colloidal Samples 

In the previous section, we described how colloidal objects can in principle be 
imaged using the confocal microscope. In this section, we discuss how this is 
achieved in practice, particularly with regard to achieving the best possible 
images. 

3.1 Sample Requirements 

For our analysis, it is required that fluorescence is present in the system, the 
particles are of suitable size and the refractive indices of the particles and 
suspension medium are suitably close. 

Most confocal microscopes require fluorescence. For particle location, it is 
necessary that particles are labelled in order to distinguish them from the 
suspension medium. The whole particle or only parts, e.g. the core, can be 
dyed. Usually the dye is chemically attached to the particles, hence prevent- 
ing dye from leaching into the solvent. However, fluorescent solvent may be 
used with undyed particles (Figure 5). Dye properties vary in both fluores- 
cence yield and how quickly their fluorescence property is lost on excitation 
(photob leaching) [22]. 

The acceptable size range for the particles is specified by the resolution of 
the microscope; around 200 - 300 nm laterally and 500 - 600 nm axially [61]. 
According to the usual Nyquist-Shannon sampling requirement [69,70], the 
distance represented by each pixel (the pixel pitch) should be around half 
this. Nevertheless, a certain degree of undersampling is permissible, since the 
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shape of the particles is known. The procedure for locating particles requires 
around 10 pixels per particle (see below), which implies a particle size of at 
least around 1 /^m diameter with larger particles resulting in more reliable 
results. Most studies have used particles with a diameter around 2 iim. 

The refractive index mismatch between the particles and suspension medium 
must be low to minimise the effect of scattering; scattering events between 
the entry point of the beam and the position being imaged reduce image qual- 
ity. The refractive index mismatch, as well as the particle concentration and 
particle size, determine the depth into the sample where images of sufficiently 
high quality can be obtained. Increasing refractive index mismatch, increasing 
particle concentration, reducing particle size and increasing depth all worsen 
the reliability of particle location. As an example, poly-methyl-methacrylate 
(PMMA) particles labelled with the dye 4-methyl-aminoethylmethacrylate-7- 
nitro-benzo-2-oxal,3-diazol (NBD) having a diameter of about 2 /im and a 
refractive index n~1.49 dispersed in cis-dccalin (n^l.48) provide usable im- 
ages for very dense samples (<1>~0.60) to a depth of around 50 fim, whereas 
the same system but with a very nearly refractive index-matching mixture 
of cis^decalin and cycloheptylbromide (CHB) provides images at more than 
100 /im into the sample (when the objective lens working distance is often 
limiting). At the other extreme, for silica (n~1.50) in water (n=1.33) useful 
data is likely to come only from within a few micrometers of the cover slip. 



3.2 Sample Containers 

The sample cell significantly contributes to the image quality which can be 
achieved from bulk colloidal systems. Although the typical sample cell is a 
simple chamber, it must be optically suitable, straightforwardly filled and 
then sealed airtight, as well as impervious to the constituents of the sample. 

The optical requirements of the cell for light microscopy have been discussed in 
detail before [60,65]. These are simplified for confocal studies, since here only 
one surface of the cell is in the optical path. The most important requirement 
is that the thickness of this cell wall must not exceed the objective working 
distance by more than the depth to which one wishes to observe. 

The widely-used capillary tubes [60,65] with typical wall thicknesses of about 
100 fj,m, although very convenient, provide poor images (which may in part 
be due to their method of manufacture) . We thus prefer to make use of cover 
glasses, which are by design of high optical quality. Constructing a chamber 
from these is generally straightforward; figure 6 shows three arrangements. The 
first (Fig. 6A) is an arrangement of cover glasses and a microscope slide which 
is held together by use of UV-curing adhesive (e.g. Norland Optical Adhesive, 
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NOA 61). The number of cover glasses can be varied to form different sized 
cavities. The cavities must be filled by capillary action, so are not suitable 
for dense and/or viscous samples. A second cell (Fig. 6B) comprises a cover 
shp attached to a machined block of material (such as PMMA). The outer 
dimensions of the cell are typically chosen for convenience to match cover glass 
sizes, whilst the inner are freely chosen. The cell is filled through a small hole 
and air correspondingly evacuated through a second hole (0.6 mm diameter is 
convenient). Once the cell is filled, the holes are sealed using UV-curing glue. 
If desired, the cell can be made suitable for observation from either side by 
attaching a cover glass to one side and a microscope shde to the other. The 
second is by far the most versatile, and remains sealed for a very long time. 
As with the first cell, it is difficult to fill with the most dense and/or viscous 
samples. In particular, care must be taken of the so-called 'self-filtration' effect 
[71]. The third cell (Fig. 6C) consists of a glass vial with its base replaced by 
a cover glass (UV-curing adhesive is again suitable). This cell is easily filled 
even with the most dense samples and its contents can be reused or adjusted, 
but in our experience cells of this type are frequently not airtight for long 
times. 



As well optically suitable and impervious to the sample, the surfaces of the 
cell should be chosen with consideration in view of wall effects. This depends 
on the specific project, for example, smoothness can cause wall-induced order- 
ing. This can be avoided by treating the surface. The simplest method is to 
deposit a drop of a dilute particle suspension on the (tilted) glass surface and 
then bake this once dry (for PMMA, 50 min at 85°C is suitable). Particularly 
if polydisperse particles are used, this provides a good non-slip coating [36] 
which discourages epitaxial crystal growth. Alternatively, one can spin-coat 
the glass surfaces with a layer of PMMA, which is subsequently covered with 
a stabiliser such as poly(12-hydroxystearic acid) (PHS), which is also used 
to sterically stabilise particles. The PMMA layer can be omitted by using a 
PHS-Si stabihser, which adsorbs directly onto the glass [72] . 



3.3 Achieving Optimum Images 



In this section we discuss how to achieve images of bulk (three-dimensional) 
samples in a digital format which are suitable for particle location. Notably, 
we discuss how to choose an appropriate pixel pitch to best balance fidelity 
and image size. We outline a recipe for capturing good quality images, and 
some common sources of poor image quality. 
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Contrast 



The intensity of light is usually detected by photomultiplier tubes (PMTs) 
or charge coupled devices (CCDs). After analog-digital conversion, the image 
is represented by a series of discrete levels, greyscales or greylevels, and the 
number of greylevels is the image depth. Visually pleasing images require that 
gradations between neighbouring greylevels are barely perceptible; this needs 
of order 100 greylevels. Frequently 256 greylevels, i.e. 8-bit images, are chosen, 
but also 10-, 12-, and 16-bit images are used. These larger image depths reflect 
that 'visually pleasing' is not always sufficient for quantitative studies. 

The recorded greylevel is determined by the illuminance (often loosely the 
power), which is device specific (e.g. the laser power entering the confocal 
microscope), as well as the gain, which scales the detector output signal, and 
the offset, which is an additive constant to compensate for a background count. 
The latter two are usually user- definable and should be optimised to maximise 
image contrast. Contrast is variously defined, but always describes the range 
of intensities present in an image. One definition of the contrast, C{x, y, z), is: 

C{x,y,z) = , 

-'0 



where Iq is the image mean background intensity, and I{x, y, z) is the intensity 
at point {x, y, z). 

Maximum contrast means using the full dynamic range of the imaging system. 
This is facilitated by using an image histogram, or occurrence count, of inten- 
sity values. Figure 7 shows typical images and their histograms, which here 
have two peaks representing particles and solvent, respectively. The histogram 
for the original image (top and bottom middle) shows an appropriate range 
of brightness, while the top and bottom rows illustrate the effect of altering 
the offset and gain, respectively. While the original image (top and bottom 
middle) shows an acceptable histogram, that on the bottom right uses the full 
dynamic range of the detector best and is thus closest to what one should 
aim for. Furthermore, one must avoid saturation, where the highest intensity 
pixels ought to take a value greater than the image format maximum (255 for 
8-bit images) and therefore are artificially restrained to this maximum value 
(Figure 8). 

Note that the operations shown in Figures 7 and 8 were performed after image 
capture and thus merely simulate the effect of adjusting the gain and offset; 
they are lookup table (LUT) operations. This raises an important point: LUT 
operations do not increase the information contained within the images. These 
are empty operations, and serve only to increase the visual appeal of the 
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images. To maximise the information retained from the imaged vohimc the 
imaging system parameters must be set so that the contrast in the detected 
image corresponds to the dynamic range at the time of capture. 



Pixel Pitch and Image Size 

As well as ensuring the image uses the full dynamic range of the detector, one 
must choose an appropriate pixel pitch and region of the sample to study. 
Recalling the Nyquist-Shannon requirement (§3.1), the pixel pitch should 
be around 100 - 150 nm laterally and 250 - 300 nm axially. The particles 
are isotropic, however, and it is convenient to have the pixel pitch close to 
isotropic. Moreover, the particle location schemes we will discuss below are 
suited to particle sizes of approximately 11-13 pixels in each direction. For 
particles of diameter 2 ^m, this suggests a pixel pitch of 150 - 180 nm in each 
direction. Since the particle shape is known, particle locations can be inferred 
to greater resolution than the sampling frequency suggests, so that a slightly 
larger pixel pitch can be chosen. 

For a quantitative analysis, a reliable means of calibration of the pixel pitch 
is essential. Standard test beads (e.g. TetraSpeck Fluorescent Microspheres) 
allow lateral and axial calibration and identification of spherical aberrations, 
but are usually too small for a reliable calibration; for a 4 /xm diameter particle 
and a pixel pitch of 0.15 /im the error in the pixel pitch is around 2%. A 
high resolution test slide (e.g. Richardson Test Shde, Model 80303) is better 
suited for two-dimensional calibration as well as identification of distortions; 
distances of order 10 can easily be calibrated, determining the pixel pitch 
to better than 1%. Using this method, it is also possible to establish variations 
in the pixel pitch across the images. 

Having determined the pixel pitch, one must decide upon the desired field of 
view. Unlike in conventional microscopes, in scanning microscopes the size of 
the region scanned, and thus the field of view, can be user-defined. The pixel 
pitch and field of view then determine the number of pixels in the image, 
which in turn is limited by the image processing hardware. (With our cur- 
rent desktop computing hardware, the limit is typically around 512x512x100 
pixels, for 16 bit images, with this requirement being relaxed as desktop com- 
puting performance, particularly memory size, improves.) The ideal choice of 
parameters is therefore a compromise between the sampling requirement, the 
desire for about 11-13 pixels per particle in each direction and the overall 
image size (or number of pixels). For the above mentioned system a voxel size 
of around 0.13 yumx0.13 /imxO.2 fim is convenient and suitable, and results 
for 512x512x100 voxels in a visible volume of about 66 /imx66 /xmx20 /xm, 
which is large enough for many purposes. 
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Capturing Images 



Initially bright-field illumination is useful to find a suitable focus in the sam- 
ple, nearest to the cover glass is most straightforward. Bright- field illumination 

affords a greater field of view, which, together with the lack of confocal section- 
ing, makes it much easier to 'find' the particles. Changing to confocal imaging 
should immediately give an image, although most likely a poor one. 

With depth in the sample, scattering decreases the signal and hence the SNR. 
Images captured deeper in the sample are thus inherently more noisy than shal- 
lower ones. Data should therefore be captured as close to the cover slip as the 
phenomenon under observation will allow (or indeed requires) . To avoid satu- 
ration, the imaging parameters, such as laser power, gain and offset, should be 
set at the shallowest (i.e. brightest) point of the region to be imaged. Though a 
nuisance, we can offset the effect of scattering against that of photobleaching. 
By starting a scan deep in the sample, where the image is of relatively low 
intensity but not yet photobleached, and proceeding to a shallower region, any 
photobleaching will tend to counteract the increase in the intensity. (Though 
the excitation light is reasonably well concentrated in the focal volume, pho- 
tobleaching is not confined to the focal plane.) For this reason, when using 
an inverted microscope wc use a coordinate system with the positive direction 
pointing 'down' with respect to the laboratory. 

Among the adjustments in the confocal microscope, the size of the confocal 
aperture deserves special attention. Smaller apertures result in a smaller depth 
of field and thus give 'more confocal' images, while larger ones provide more 
collected light. Particularly when the shape of the particles is known the gain 
in hght collected and therefore SNR may offset the loss of resolution due to the 
broadened PSF. The amount of collected light also depends on the acquisition 
time, which should be significantly shorter than any relevant time scale of the 
sample [50]. 



4 Finding Particle Coordinates 

4-1 Dealing with Noise 

Here we describe how to deal with noise prior to feature extraction. Apart 
from slight modifications, this procedure follows a method described previ- 
ously [47] . Noise may include geometric distortions, non-uniform contrast and 
instrumental noise. We will not discuss geometric distortions, the absence of 
which can be confirmed using a test slide; supposing they were present, they 
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can be dealt with using standard algorithms [47] . 



Contrast Gradients 

The procedure we describe was originally intended to process images captured 
using CCD cameras. Such images, in which different pixels are sampled by dif- 
ferent detector elements of, in general, different sensitivity, frequently display 
contrast variations. Even if in most confocal microscopes all of the pixels are 
scanned by the same detector, this procedure corrects for non-uniformities in 
illumination across the field of view. 

Provided the image contains features which are suitably small and sufficiently 
far apart, large scale variations in the background (we take this to mean on 
a length larger than the particles) can be adequately modelled by a 'boxcar' 
average of extent 2w+l, where w is an integer larger than the sphere's ap- 
parent radius in pixels, but less than the typical intersphere separation and 
can be different in the three dimensions [47] . This corresponds to a real-space 
convolution of the image with the following kernel: 

A^{x, y, z) = .3 Yl Mx + i,y + j, z + k) (7) 

^ ' i,j,k=—w 

This correction relies on the assumption that features are 'small' and 'well 
separated', which, loosely, means that the typical intersphere separation is 
larger than the sphere. For samples of volume fraction 0~O.5 or greater, this 
is not true. Nonetheless, we see later that the results are reasonable. 

We note that contrast gradients may genuinely be present. For example, in an 
image of a crystalline sample, crystallites may lie in slightly different planes 
from one another, giving rise to a genuine contrast variation. We assume that 
such effects are negligible. 



Single Pixel Noise 

For confocal micrographs of colloidal samples, the instrumental noise often 
comprises a significant proportion of single pixel noise. This would ordinarily 
be dealt with using a median filter [68] ; each pixel is replaced with the median 
value from its neighbourhood, whose size is typically chosen to be 3, 5, or 7 
pixels. This has a smoothing effect which deals well with single pixel noise. In 
keeping with many earlier studies, we prefer another approach. It is difficult 
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to defend this over the median approach a priori, but it turns out to work 
well, and is remarkably robust. 

We assume single pixel instrumental noise, or, equivalently, that the noise has 
correlation length A„~l pixel. Removal of all features having this lengthscale 
by low pass filtering would certainly eliminate single pixel noise, but this has 
the disadvantage of blurring edgeQ Rather, the usual approach is convolution 
of the image with the kernel: 

^ ^ ^ ■ ■ ,^ ( 

A\Ax,y,z) = — 2^ A{x+t,y+j,z+k) exp\ -— I (8) 

i,j,k=—w \ n / 



Et-^expi-iP/AXD) 



. Since 



where B is the normalisation condition, B 
the Fourier Transform of a Gaussian is itself a Gaussian, this attenuates high 
frequencies as desired, while more adequately preserving edges. 

It was shown [47] that that these two operations (equations 7 and 8) can be 
implemented in a single step using the following kernel: 



B 



exp 



+ f + k^ 



{2w + 1)= 



(9) 



The normalisation Kq = 1/B [Er=-^ exp (-(iV2A^))] ^ - (5/(2^+1)^) is ap- 
propriate for comparison between images filtered with different values of w. 
Xn is again set to unity. 

A practical limitation on the convolution arises since it involves, for each 
point {x,y,z) in the original image, a sum over all points {x+i,y+j, z+k) 
for i,j, k = —w . . .w. This cannot occur for any point which lies less than w 
pixels from the edge of the original image. In practice these are often discarded. 
Depending on the application, it may be useful to have coordinates from this 
region despite the reduced information. To achieve this, the original image is 
'padded out' with a border of width w around the entire volume. (Above and 
below the stack the pixels are all set to the mean intensity value in the first and 
last slices respectively. To the sides of the stack, the border around each shce is 
set to the average value of the intensity in that shce.) This padding permits the 

^ Low-pass filtering, in its simplest form, involves cutting from the Fourier Trans- 
form of the image all points that lie above a threshold frequency. Such a circular 
region in the Fourier Transform gives rise, upon Fourier transforming once more, 
to a real-space convolution kernel of the form ^iowpass=<^i(?'/^^o)/('^/i^o)) where 
r'^=x'^+y'^+z'^ and wq is the threshold frequency. This kernel effectively places a 
jinc function, or series of concentric rings, about each point in the original image, 
thereby blurring beyond usefulness the processed image. 
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entire image to be retained, while the padding is discarded afterwards. This 
average is necessarily not ideal and somewhat arbitrary (one cannot generate 
information which is not in the image initially), making particle coordinates 
within the border inherently less reliable than those from the bulk sample. 
Interestingly, failure to carry out the padding introduces artefacts into the 
Fourier Transforms of the images; if the Fourier representation is useful, this 
may be important. For details of the artefact, see [41]. 

Figure 9 (left) illustrates a slice from a typical good quality stack of a largely 
crystalline region. The volume was then filtered using the three-dimensional 
algorithm, and the same slice extracted once more (Fig. 9 right). This example 
is of a successfully filtered image. In dense samples, neighbouring particles 
occasionally show 'bridges', or small bright bands connecting their images. 
This is an important but unavoidable problem which we discuss in detail 
later. 



4-2 Strategies for Finding Particle Coordinates 

The centre of a particle can only be identified from its image by relying on 
a priori knowledge of its shape. In our case each particle is spherical, and, 
following the arguments above, we thus know the shape of the fluorescence 
intensity profile through each particle's image. Use of a priori knowledge in 
this way is known as Bayesian inference, and is widely used in many fields 
[73,74]. Even the simplest particle location scheme infers coordinates by taking 
advantage of this information and is therefore in this sense Bayesian. 

A priori knowledge of the particles' shapes permits location of the particles to 
higher precision than the sampling rate. This sub-pixel resolution ultimately 
allows location of particles to substantially better than the resolution of the 
microscope. In principle there is no limit on this statement, though inherent 
experimental error and limitations in the interpolation techniques ensure a 
maximum resolution which cannot be known in advance; we address this later. 

We consider three strategies to identifying particle locations. The first involves 
identifying particles and subsequently inspecting each in turn (Sec. 4.2.1). 
This is widely used, but can only be useful when finding the centres of solidly- 
fiuorescent spheres. The second, a deconvolution method to extract instances 
of the particle image (Sec. 4.2.2), is more general, but not used here. Similarly, 
the third, the Hough Transform (Sec. 4.2.3), is very general and, we argue, 
suitable for further exploitation in colloidal studies, but not used here. A re- 
cent study carried out a computational comparison of some of the methods 
described below [75] . They found, perhaps unsurprisingly, that a direct Gaus- 
sian fit to the intensity profile was most successful for point sources (where the 
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measured intensity profile ought to be simply the PSF), whereas a pattern- 
matching approach (sec 'Refinement using Measured SSF', below) was more 
successful for larger particles. They did, however, neither consider real data 
nor the more complicated situation where several particles are present. 

4-2.1 Identification of Local Brightness Maxima and Subsequent Refinement 

The majority of particle location schemes operate on the assumption that the 
image of a particle has a maximum intensity at, or near to, its centre, i.e. 
that there is a one-to-one correspondence between local brightness maxima 
and particle centres. ('Local' is important since the image brightness can in 
general vary dramatically on the scale of several particle diameters without 
compromising the technique.) In practice, however, the sampling grid will 
never coincide with the sphere centre and also other imperfections, for example 
resulting form noise, have to be considered. Nevertheless, we assume that 
based on the local brightness maxima we can reach nearest pixel accuracy. 
The refinement step then gives subpixel resolution. There is a hierarchy of 
possible refinements, based on the extent to which the a priori knowledge is 
relied upon. 

Refinement Using the Spherical Symmetry of the SSF: Centroiding 

The simplest technique relies only on the knowledge that the SSF is spherically 
symmetric. This is by far the most widely-used technique [53] and will be 
described in detail in Sec. 6. 

Refinement Using a Functional Form for the SSF 

Rather than using a centroiding approach, i.e. the fact that the SSF is spher- 
ically symmetric, the ftmctional form of the SSF could be used. Already an 
approximation to the functional form might improve the centroiding approach. 
In particular, it improves the performance in the case of SSF overlap, which 
is modeled by a simple superposition. 

In related systems, such as particle image velocimetry (PIV), as well as the 
n-point centroid estimators, there are two widely used approximations to the 
functional form [53] . The first is a parabolic peak fit with the functional form 

and similarly for y and z. Based on this model, the 'true' position {xq, yo, Zq) 
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of the particle is: 



xo = i + 

yo=j + 



f{i-l,j,k) - f{i+l,j,k) 



f{i,j-l,k) - f(i,j+l,k) 
f{i,j,k-l) — f{i,j,k+l) 

2/(j,j,fe-i) - 4=f{i,j,k) + '^f{i,j,k+i} 



where k) is the candidate (integer) location and f{i',j', k') is the intensity 
of the sampled image at position (i', j', k'). In our work, there is no basis for 
using a parabolic fit. 

A Gaussian fit seems more appropriate [47] , although the deviations are some- 
times significant (Sec. 2.2, [63]): 



C exp 



-{xq-x) 
k 



This implies that 

InSGauss OC -{xo-xY, 



SO that the three-point Gaussian estimate is parabolic in the natural logarithm 
of the sampled points f{i,j, k): 



^ _-j ln/(»-ij,fc) - ln/(i+ij,fc) 

2 In /(i-i — 4 In f{ij,k) + 2 In f(i+ij,k) 

and similarly for t/q and Zq. These three-point estimators are convenient and 
widely applied. They rely on the image of the particle being around three 
pixels in diameter [53], which may not permit the desired sampling rate: re- 
membering Section 3.3, the pixel pitch ought to be around 0.2 /im, so a typical 
colloidal particle suitable for confocal microscopy (diameter ~2 nm) need be 
at least 10 pixels in diameter. Once again, knowledge of the functional form 
of the SSF may allow recovery of the particle location despite the apparent 
undersampling. It is not possible in principle to resolve this conflict, and opin- 
ions, judging by the literature [23,22], differ on exactly what is the appropriate 
choice. 

Fitting to a functional form outperforms the centroid approach when the SSFs 
of neighbouring particles overlap. It is well documented that the above fits are 
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appropriate only for well-rcsolved correlation peaks [53,76]. Progress in this 
direction has not been attempted, largely because the functional form is not 
in general known. An approach which avoids this deficiency is described next. 

Refinement Using the Measured SSF 

In this case, the SSF is measured in a window just larger than the SSF itself. 
'Stamps' of this SSF around the candidate particle locations are then fitted 
to the image. Provided the SSF was sampled appropriately, it also accounts 
for aberrations and imperfections, and more accurately for the system PSF. 
We describe this technique in Section 7. 

4.2.2 Particle Location by Deconvolution of the SSF 

If we are to extract instances of a motif, as the above refinement using the 
measured SSF suggests, then a deconvolution technique is seemingly more 
appropriate. We have established that the imaging system can be represented 
as a convolution process (Sec. 2.1, Eq. 2), and we could in principle recover 
the original form of an imaged object by deconvolution of the PSF from the 
observed image. Similarly, the image of a particle is formed by placing a copy 
of the SSF (the above 'stamp') at the particle coordinate (Sec. 2.2, Eq. 4). 
From Equation 5 it follows that 

where J^^^{} denotes the reverse Fourier Transform. Thus by deconvolving 
the SSF from the image of a particle, we obtain a single bright point at its 
centre which is easily located. 

If there are several spheres in the image, the situation is complicated slightly, 
since it is not possible to define the centres of all spheres as being at the origin. 
The Fourier Transform of a delta function which is not centred on the origin 
is: 

00 

:r{5(r-ro)}(k) = j 5(r-ro)e-''^^'^'"dr = e-''^''^'"°. 

r=— 00 

Thus the Fourier Transform is no longer constant, but contains phase informa- 
tion which encodes each particle's distance from the origin. This is the reason 
why the locations of several particles can be determined by the deconvolution 
process. 
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In the case where the field of view contains N particles at positions rj, the 
image can be written (Eq. 4): 

N 

f{x', y', z') = ^ 5(r-ri) s{x, y, z) . 

i=l 

Since the Fourier Transform is a linear operation, this gives us (Eq. 5) 

N 

F{u, V, w) — aiS + + ... — S'^ai, 

i=l 

with an the Fourier transform of the n^^ delta function. Finally we obtain 
^-^{E«^}=^-^{f} = E5(r-r.). (10) 

Thus by measuring the sphere spread function s carefully, we could in principle 

deconvolve it from the observed image /, to obtain a series of bright points 
indicating the positions of the imaged spheres. Locating the bright points then 
returns the positions of the particles. 

Although this technique is appealing, it is very sensitive to noise in the de- 
tected image, similar to the deconvolution of the PSF [41]. The effect of noise 
in Fourier space is (Eq. 6): 

G{u, V, w) — F{u, V, w) + N{u, V, w). 

Noise is usually additive and highly locahsed in the object space, i.e. single 
pixel. In Fourier space, the noise is therefore highly delocalised, and its am- 
plitude \N{u,v,w)\'^ nearly constant. Dropping arguments we write 

G F N OS N ^ N 

s s s s s s 

If there is no noise present, we recover the expected form (Eq. 10). 

This technique shares a problem inherent in many deconvolution processes: 
Wherever the function S falls near to zero, the first term on the right hand 
side is liable to become very large (depending on the behaviour of F at that 
point), while the second term is certain to become very large, since N is 
approximately constant. Because many deconvolution kernels contain zero- 
height pixels, deconvolution of a noisy image cannot be relied upon in this 
simple implementation. 
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There are several schemes for circumventing this difficulty. For example, one 
can seek the solution which contains the same information in Fourier and real 
space (Weiner or Optimal Filter). Furthermore, Maximum Entropy techniques 
determine as smooth an image as is consistent with the original data. To our 
knowledge, these techniques have been sparingly used in colloidal systems 
[39,40] and we thus refer to the literature for details [68]. 



4-2.3 Hough Transform 

The Hough Transform is a feature extraction technique popular in computer 
vision [68]. The original version identified lines [77], and this has been gen- 
eralised to find the outlines of arbitrary shapes [78,79]. It can be applied to 
differently shaped objects and is in particular not restricted to particles with 
a bright centre. However, at least in its simple form, a suitable parameterisa- 
tion for the outline of the shape has to be found. (In the generahsed version, 
the parameterisation is in the form of a lookup table.) Briefiy, the Hough 
Transform operates by inverting the parameterisation so that the parameters 
become the coordinates (in Hough space) and the real-space coordinates be- 
come parameters. When points in real space are transferred to Hough space, 
any regions of high point density indicate objects and their parameters. This 
is assessed using accumulator cells, or bins, whose size dictates the precision 
to which the parameters are found. 

The Hough transform has been applied successfully to systems of discs [80,81] 
(in fact, spheres viewed in two-dimensions), and would presumably translate 
well to colloidal studies, but we are not aware of any three-dimensional studies. 
This might be due to the difficulty of extending the Hough Transformation 
to systems with many parameters, in particular the need for many points per 
accumulator cell for reliable parameter determination. In addition, the Hough 
Transform is dependent on the object outlines (edges) having been detected 
reliably. 



5 Tests of Accuracy 



Before we present the centroiding and SSF refinement techniques in detail (Sec. 
6 and 7), we review some tests which can be used to compare the accuracy of 
both techniques. At least the first three of these are well known [47,52]. 
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5.1 Basic Tests 



There are two basic visual tests. Firstly, a reconstruction that places an image 
of a sphere at its supposed position gives a very crude indication of believability 
(Figure 10), although this gives no objective measure of accuracy. 

The one-to-one correspondence between particle images and detected locations 
can be checked using markers (e.g. crosses) on the original image (Fig. 11). 
Without an empty magnification it is, however, only possible to overprint 
markers to the nearest pixel. 



5.2 Test for Rogue Particles 



For a perfectly imaged sample, each particle image should be identical; vari- 
ations may indicate imperfectly located particles. Simple properties charac- 
terising the particle image are its total brightness, peak brightness, the first 
moment of its intensity distribution (its radius of gyration), and its ellipticity 
[47]. For identical particles, we expect these values to fall within a narrow 
band of values. Figure 12 shows two examples, the radius of gyration squared 
of a particle versus its total brightness (left) and its peak brightness (right). 
Most points are close together within a tight locus except a few, which might 
be disregarded as rogue particles. However, it is never certain what the ac- 
ceptable locus is, and correspondingly never obvious where the cutoff should 
occur. Furthermore, this does not allow us to infer the reliability of particle 
locations on an individual basis. 



5.3 Test for Pixel Biasing 

All of the techniques we consider here involve finding the nearest pixel to 
the true centre first and then refining this candidate particle location. If the 
first step fails, particle locations are not reliable, which can be detected, for 
example, by the above means. However, if the first step is successful but the 
refinement step fails, the particle locations are sometimes biased towards in- 
teger values. We can detect this using the distribution of the fractional part 
of the particle location, which should be evenly distributed from zero to one 
(Fig. 13). 
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5-4 Tests based on structural properties 



Often it is possible to compare the structural properties of an ensemble of 
particles with the expectation either from theoretical studies, or from simu- 
lations. Although there are many possible structural descriptors, the radial 
distribution function, g{r), is most commonly used to check the reliability 
of the particle location. The height of the first peak and its sharpness, i.e. 
where it begins to rise (which ought to be infinite and 2r respectively for hard 
spheres), are useful indicators of the reliabihty of the determined particle loca- 
tions. Nevertheless, is it rather a measure of location precision than accuracy 
and it is also an average quantity, and hence unable to test individual particle 
locations. We will use this criterion in Sees. 6 and 7. 



5. 5 Checking the volume fraction 



The volume fraction of a sample as prepared is often only known with a 
large systematic error [41]. It can therefore be helpful to calculate it from the 
determined particle coordinates, which can also serve as a consistency test for 
the coordinates. 

The total volume fraction can be determined from the volume of the imaged 
region, Vf,ox, the number of particles it contains, N as well as their radii, R: 

^ _ 4 ^3 AT 
3 Vfjox 



This depends on a reliable determination of the particle number A^, i.e. that 
neither particles are missed nor spurious particles are added. To overcome this 
problem in spatially homogeneous samples, we can determine the local vol- 
ume fraction for each particle. This requires us to determine the volume per 
particle, which can be found by partitioning the space appropriately; there is 
no unique way of doing this, but the Voronoi construction [82] is well-defined 
and physically sensible [41] . For a homogeneous sample the local volume frac- 
tion ought to be similar (within a certain distribution) for all of the particles. 
Anomalously large volumes will be attributed to neighbours of a missed parti- 
cle, which can be ignored in calculating the mean volume fraction. The volume 
per particle, and its distribution, may itself be of interest in spatially hetero- 
geneous samples. 

The value of as determined from the particle coordinates is subject to a 
systematic error, due to the error in the determination of the particle radius, 
R. Typically, an error of around one percent in R can be achieved (corre- 
spondingly, three percent in 0). It is usual to get the random error in the 
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coordinate-derived to much better than this. For details of a comprehensive 
dataset, see [41, Figure 8.1]. 



6 Centroiding 

In this section we describe centroiding as commonly applied to colloidal sys- 
tems. We note that centroiding methods are used in several other fields. Most 
notable is particle image velocimetry (PIV) [53], in which roughly-Gaussian 
shaped (correlation) peaks are located [83,84,85,86,87] with some using more 
sophisticated procedures, such as the three-point estimator (Sec. 4.2.1) [53,87] 
or iterative procedures [88]. They also include discussions on the accuracy of 
centroiding [76] as well as the presence of noise [89,90,91]. The centroiding 
method was first applied to two-dimensional projections of colloidal samples 
by Murray and Grier [43], and then refined in the classical paper by Crocker 
and Grier [47] , which also forms the basis for the routines by Weeks [52] . All 
centroiding algorithms seek to find with maximum accuracy the position of 
the centroid of an image distribution, but in colloidal studies this is, as we 
will explain, not always what we desire. Although this section is particularly 
relevant to Weeks' tracking routines, it is not uniquely so and should also be 
relevant to most other centroiding routines. 

6. 1 Procedure 

After filtering the raw image (Sec. 4.1), the image is searched for local maxima 
to determine the candidate particle locations, i.e. the nearest pixel (integer) 
to the 'true' location. Local maxima are simply the brightest points within a 
three-dimensional region (of size 2 x separation, see below). Subsequently a 
window (of size extent) is considered around each candidate particle location. 
Within this window, the centroid of the image intensity distribution is taken, 
giving the final particle coordinate. Other properties of the intensity distri- 
bution, such as total brightness, peak brightness and radius of gyration, can 
easily be determined within this window. 

To avoid problems due to external noise, most notably the infiuence of light 
from objects other than that under study, the algorithm ignores all pixels 
within the above window whose intensity falls below a certain fraction (quan- 
tified by threshold) of the peak height belonging to that particle. Statistics 
calculated for a particle hence refer only to pixels having intensity greater 
than this fraction of the peak intensity. In addition to this 'local' threshold, 
it can be useful to disregard any features whose peak brightness is less than 
a certain fraction of the brightest feature of the whole image, on the grounds 
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that these are spurious. While it is possible for the brightness of features to 
vary substantially within an image, particularly for dense objects which are 
poorly refractive index-matched to the solvent, this is a useful safeguard and 
commonly chosen (arbitrarily) to be around 0.7. 

6.2 Parameter Optimisation 

The centroiding technique is in general quite robust to variations in its param- 
eters, as we will show in this section. Since the parameter space is huge, we 
concentrate on its most useful portion and illustrate the effect of the different 
parameters using a high quality image. It is a 512x512x100 image with a 
pixel pitch of 0.16 //mxO.16 //mx0.20 //m and originates from PMMA parti- 
cles of radius r=1.09 fim. and volume fraction $~0.64 in cis-decalin and was 
taken using a BioRad confocal microscope. We use as standard parameters: 
separation=[6, 6, 5], extent=[13.0, 13.0, 11.0], threshold=0.5 and for noise fil- 
tering (w, as defined in Sec 4.1) [13, 13, 11]. The effect of the parameter choice 
is judged using the radial distribution function g{r). As argued in Sec. 5.4, 
the height of the first peak and the distance where the first peak begins to 
rise. Although the importance of individual parameters depends on the exact 
system under study and the indicators for reliability, the following discussion 
reflects general trends. 

Noise filtering parameter 

Figure 14 A shows the dependence on w, the length specified in the filtering 
procedure. Slightly larger windows are acceptable ([15,15,13], violet, is bet- 
ter than [13, 13, 11], black, but very similar to [17, 17, 15], light blue), while 
too small windows should be avoided ([7,7,5] and [6,6,5], both green). Fur- 
thermore, anisotropic windows (above and [11,11,9], blue; [9,9,7], cyan) are 
preferable, although isotropic windows ([13, 13, 13], yellow; [11, 11, 11], orange; 
[9, 9, 9], red) still work reasonably well. 

Separation Parameter 

The parameter separation is a 3-element integer vector. Typically, the par- 
ticles are of radius r~l /xm and the pixel pitch about 0.15 /xm laterally and 
0.2 iim axially and thus the particle radius will be around 6 pixels laterally 
and 5 pixels axially. This suggests separation — [6, 6, 5]. 

Since this parameter determines (half) the minimum separation between can- 
didate particle locations and is furthermore used solely to find candidate 
particle locations, and is not used in the refinement step, it will only de- 
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termine the number of detected particles. Four cases are shown (Fig. 14B): 
separation=[5, 5, 4] (green), [6, 6, 5] (black), [7, 7, 6] (blue) and [13, 13, 11] (red), 
which result in 16417, 16322, 16476 and 2119 locations respectively. There is 
only a weak dependence of the particle number and g{r) on separation pro- 
vided its value is near to the particle radius. This is because the particles are 
very similar in size; as long as separation is sufficiently small to capture essen- 
tially all of the particles, it has almost no further effect. separation=[13, 13, 11] 
is clearly too large and therefore excludes many bright peaks, g{r) is corre- 
spondingly noisier (as it is based on only about 10% of the particles), but 
also has its peak shifted upwards by about 5%, since the analysis finds only a 
subpopulation of apparently larger particles. 



Eodent Parameter 



The window for the refinement should cover a particle and have an odd in- 
teger size. (The latter is for technical, image processing reasons; a window 
should have a unique central pixel.) In the present example we thus choose 
exieni=[13.0, 13.0, 11.0] instead of [12.0, 12.0, 10.0]. 

Figure 14C shows that the exact choice of extent is not critical as long as the 
window is large enough: [13.0, 13.0, 11.0] (black) is very similar to the larger 
[15.0, 15.0, 13.0] (blue), while the smaller [11.0, 11.0, 9.0] (cyan) is inferior. Also 
an anisotropic window, [13.0, 13.0, 13.0] (green), [11.0, 11.0, 11.0] (yellow) and 
[9.0,9.0,9.0] (red) is possible, again provided it is large enough. This is en- 
couraging, because the size of the window must be chosen by eye from the 
original image. 



Threshold Parameter 



The effect of the threshold parameter depends strongly on the image quality. 
In the present example. Fig. 14D, it is weak. With increasing threshold^ the 
peak height first increases (0.1, black; 0.2, violet; 0.3, blue; 0.4, cyan; 0.5, green; 
0.6, light green) since pixels which are likely to be spurious are disregarded (as 
intended), but then the peak height decreases (0.7, orange; 0.8, red), which 
is due to a smaller number of 'valid' pixels and thus a reduced reliability. A 
compromise value of about 0.5 is generally a good choice. We reiterate that this 
is a local threshold parameter used only the refinement step, and unrelated to 
any global value such as that described in 6.1. 
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6.3 An Appraisal of the Centroiding Technique 

The centroiding technique is clearly successful, for at least some sample con- 
ditions. For example the radial distribution functions found from density- 
matched crystalline samples are convincing [22] and also glassy sediments give 
good results (Fig. 15, left) even for relatively low quality images (right), for 
example those obtained at a high capture speed. This figure indicates that 
these samples give rise to good g{r) under the right imaging conditions and 
suggest that poor quality g{r) may be due to the particle location method 
rather than the sample. 

However, this technique also has shortcomings. Usually an accuracy of around 
30 nm in the lateral and 50 nm in the axial directions are claimed (for example, 
[3]). Since these values should depend on the experimental conditions, such 
as the sample properties, the noise present and how the image was captured, 
one needs, however, to assess the accuracy of each individual image or, ideally, 
even each particle location in an image. 

The precision with which particle locations have been found can be inferred 
by plotting the radial distribution function g{r) with increasingly smaller bins 
of radial distance r. Assuming the sample contains sufficiently many particles, 
this will result in a successively sharper peak until the effect of the bin size is 
no longer seen. Then the bin size is lower than the mean precision to which the 
particle coordinates are known. This precision is typically around 30-40 nm for 
the samples used in this enquiry, which is at best a lower bound on the typical 
accuracy of particle locations. However, the precision to which the locations of 
the centroids of particle brightness arc known is not the same as the accuracy 
with which the particle locations are known, because the centroid of a particle 
image's brightness is not necessarily the centre of that particle. This is a 
consequence of imaging objects that arc close in size to the resolution of the 
microscope. This results in images — or SSFs — of particles which are larger 
than the particles themselves (Fig. 3) and thus the possibility of overlapping 
images or SSFs. 

Figure 16 shows the case where two particles are so close to one another 
that their SSFs overlap. In this case, the intensity distribution in the centroid 
window is clearly asymmetric, and the centroid does not correspond to the true 
sphere centre. The apparent particle locations are too close together, which 
explains contributions to g{r) at distances less than 2r. 

The intensity profiles calculated for two particles with diameter 2 yum at con- 
tact are shown in figure 17. Between the particles the intensity drops to 57% 
of the peak intensity in lateral direction (left). Due to the lower resolution 
in axial direction, the intensity falls only to around 90%, if the particles are 
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touching in this direction (right). Depending on the noise level, this might 
result in no detectable intensity drop between these two particles. 

The centroiding technique will thus become unreliable in dense suspensions 
with a large fraction of touching or close particles. The distance below which 
particles cannot be resolved any longer depends on the conditions, but is 
typically below 1.3 particle diameters. 

The fact that the image of a particle can be larger than the particle itself is 
not specific to confocal microscopy. Since we began investigating this effect, 
another group has suggested that the corresponding effect for normal bright 
field microscopy has been responsible for a significant controversy on so-called 
hke-charge attraction (e.g. [92,93]). It has been demonstrated that the over- 
lap of particle SSFs (our terminology) can result in an apparently decreased 
or increased separation of particles [63]. The increased separation arises be- 
cause the intensity profile of a single particle is non-monotonic for brightfield 
microscopy [59,63], rather than the (overly simplistic) monotonically decreas- 
ing form used here. (Here the Gaussian approximation to the PSF is notably 
inadequate.) 

The problem of SSF overlap can be avoided by using so-called core-shell parti- 
cles (for example, [2]). They consist of a fluorescent core and a non-fluorescent, 
but otherwise identical shell. The shell is large enough that the SSFs of touch- 
ing particles do not significantly overlap. Core-shell particles are, however, 
more difficult to obtain and necessarily have fewer bright pixels per particle, 
so that it may be necessary to oversample the images to provide sufficient data 
to allow the centroiding procedure to work. Care must also be taken regarding 
polydispersity: the cores can be polydisperse when the shells are not, and vice 
versa. 

We feel it is appropriate here to reiterate that despite the limitations of cen- 
troiding, it is certainly an effective and robust technique under suitable cir- 
cumstances. Its relative simplicity commends its use where possible. In par- 
ticular, it is reliable in dilute samples, where there is a small probability of 
SSFs overlapping one another. Furthermore, although we have not dealt in 
depth with polydisperse samples, the fact that centroiding relies only on the 
particles being spherically symmetric suggests that it ought to be applicable 
to these systems. 



7 SSF refinement 

To address some of the difficulties inherent in the centroid method, we have 
developed an iterative technique which takes into account the known shape 
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of the SSF, using the 'Refinement using the Measured SSF' strategy (Section 
4.2.1); we refer to this as SSF refinement. 

As before, the raw image is first filtered (Sec. 4.1) and, as with the centroid- 
ing technique, the image searched for local maxima to determine candidate 
particle locations. Then, instead of taking the centroid of the image intensity 
distribution within a window surrounding the candidate particle location, an 
experimentally determined SSF is fitted to the original image in the vicinity 
of the candidate particle location. This is done, following similar work [94,95] , 
with a chi-square test [96] . 

7. 1 Determination of the Experimental SSF 

The average image of a large number of individual particles would ideally pro- 
vide an experimental SSF. This requires, however, separate and slow-moving 
particles, which is difficult to achieve. Furthermore, these particles should be 
part of the sample of interest to have identical imaging conditions. Only in 
this case does the SSF properly account for aberrations and imperfections such 
as those caused by index mismatch between the sample and the immersion 
oil, i.e. it genuinely reflects the system PSF. This can even depend on, e.g., 
the depth in the sample. In contrast, a different reference sample may not 
accurately reflect the image, and thus SSF, of the particle in the sample of 
interest. 

Therefore in most cases only an approximation to the ideal experimental SSF 
can be determined. A region of appropriate size is considered around each of 
the (nearest integer) candidate particle locations as determined by the cen- 
troiding technique. The number-weighted mean of these images is then taken 
as the SSF, Sexp{x" ,y" , z"). The resultant SSF is insensitive to a number- or 
intensity-weighted average. This average results in an SSF which is broader 
than the 'true' SSF, but this seems not to affect signiflcantly the quality of 
the obtained particle locations. 

7.2 Determining Particle Locations 

Having determined the SSF experimentally, we have established how the vicin- 
ity of each particle ought to look. We can now reflne the (nearest integer) can- 
didate particle locations. Within a window around these locations, we search 
for the location which best matches the SSF. The size of this window is chosen 
to match the accuracy of the centroiding procedure, typically less than 2 pixels 
in each direction: in the worst cases, the flrst peak of g{r) begins to rise at 
about 70% of one diameter, 2r, i.e. contacting particles are apparently about 
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0.3 X 2r too close and their locations are thus wrong by about 0.15 x 2r, or 
about 2 pixels, since the diameter corresponds to typically 11-13 pixels. For 
particularly noisy images, this value should be increased. 

The experimentally determined SSF, Sexp{x" ,y" , z"), is expressed in terms of 
its own (integer) coordinates x", y" and z" with 0<x"<ea;tent(0), Q<y" <extent{l) 
and 0<z" <extent{2) . The detected image I{x', y', z') is also known only at in- 
teger locations. The image of particle i is extracted from this: Ii{x" ,y" , z"). 
We have chosen to change to the double prime coordinates which are mea- 
sured within particle z's own window, allowing straightforward comparison 
with Sexp] coordinates in this system are straightforwardly related to the par- 
ticle's global coordinate {x[, y[, z[). For a meaningful comparison between s^xp 
and J, they must be normalised consistently while exploiting the full dynamic 
range. This can be achieved by normalising the SSF to occupy the entire range 
of greyscales and then scaling the image of each feature, y', z'), such that 
its peak height matches that of the SSF. Noise renders this an approximation, 
but seems not to significantly affect the procedure. 

The chi-square hypersurface of particle i as a function of the overlap coordi- 
nates (j, k, I), is then: 

2,.,n ^ [sexpjx", y", z") - hjx" + J, y" + k, z" + l)f 

x",y",z" '~'x",y",z" 



where the sum runs over all x", y", and z" (i.e. every pixel value in the SSF is 
compared with every value in the current particle 'image') and j, k and I take 
the values < j < 26i, < k < 2S2 and < / < 253 with the iteration grid 
size (2^1 + 1, 262 + 1, 253 + 1) (This makes it impossible to extract features 
which lie within half of the iteration grid size of the edge, as for the centroiding 
technique.) The uncertainty associated with each point, <Jx"^y'\z", is assumed 
to be constant, although photon counting statistics suggests an intensity de- 
pendence. Again, we obtain good results despite this approximation. 

The chi-square values display a minimum near to the genuine particle loca- 
tion (Fig. 18), which, due to the different resolution, is usually shallower in the 
axial (z) than in the lateral (x, y) directions. Everything so far has involved in- 
teger coordinates; for subpixel resolution, we need some form of interpolation. 
To locate the minimum to sub-pixel accuracy, we consider two interpolation 
schemes. 

The first is to produce a fit to the SSF which is overlain on the image and 

^ The grid coordinates run < j < {2Si + 1) etc. in the SSF/particle ('double 
prime') coordinate system, or —6 < j < 6 in the global ('single prime') coordinate 
system. 
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moved in any direction. This not only requires a fit function, which is in general 
not available, but also leads to the ambiguity that a variation in can either 
be due to a change in the quality of the fit to the image, which is desired, or 
to a change in the quality of the interpolation of the SSF. 

The strategy we adopt here is different. We determine the minimum by inter- 
polating the surface in the three directions (j, k, I) independently, typically 
using the five data points closest to the minimum in each direction. By re- 
peatedly interpolating for a large number of points lying within half a pixel 
of the minimum of the array, we obtain an array of sub-pixel estimates to 
X^. The lowest- valued entry in this list gives the best correspondence between 
the measured SSF and the image of the feature. A precision of one hundredth 
of a pixel is more than necessary, but still computationally tolerable. A crude 
error estimate can also be made by estimating the error in the interpolation; 
one popular interpolation algorithm, POLINT, does this by default [97, §3.1]. 



7.3 Appraisal of the SSF refinement technique 

We illustrate the result of a SSF refinement using two examples (Fig. 19); 
further examples can be found in the literature [41,42]. They are based on 
the previously used data set (Fig. 15). In the case of the high quality image 
(Fig. 19 (left)), the obtained g{r) is reassuringly similar to the one from the 
centroiding technique. The first peak begins to rise at very slightly higher r, 
about 0.9 diameters, which is reasonable, because the polydispersity of the 
sample is about 5%. In addition to the sharpening, the height of the first peak 
is increased by about 20%, which indicates that even a relatively satisfactory 
analysis can be improved by the SSF refinement technique. 

The situation is different for an image of mediocre quality (Fig. 19, right). Here 
the g{r) obtained by the centroiding technique is quite poor. In contrast, the 
SSF refinement technique results in a g{r) with a first peak which is sharper, 
it begins to rise at about 0.8 diameters (as opposed to 0.6 diameters for the 
g{r) from the centroiding technique), and higher, by more than 50%. We also 
notice the occurrence of some noise at very small r; since g{r) is calculated 
by dividing by r^, this can be caused by a very small number of erroneous 
particle locations. (As we will explain below, these can be identified.) The 
SSF refinement technique results, in particular for sub-optimal data, in an 
improved quality of particle location. 

SSF refinement works partly because it searches neighbouring pixels, that is, it 
does not assume that the centroid coordinates are correct to the nearest pixel. 
Noise in the data means that, despite the noise filtering step, the brightest 
point of a particle's image may not be the nearest to its true position. This 
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might also apply to dilute suspensions with fast-moving particles [23]. Since 
the ccntroiding procedure uses the brightest point as the nearest-pixel esti- 
mate, this leads to an error of at least one pixel in some cases. An iterative 
version of the centroiding procedure, should show some of the improvement 
we have found. This requires goodness of fit information for each individual 
particle, which we provide here. 

In we have a measure for the accuracy of the location of each individual 
particle. We can thus not only compare the quality of different images, but 
also individual particle locations. It is important to remember that any par- 
ticle location scheme relies on a priori knowledge of the sizes and shapes of 
the particles. The less we know about any given particle (for example, how 
much its radius differs from the mean) , the less successful the particle location 
is hkely to be. This will be reflected in the value, which can be obtained 
on an individual particle basis. Whether a poor ^ value is due to a poorly- 
determined location or a poor match between the particle image and the target 
SSF has then to be investigated. This information can be used when calcu- 
lating and interpreting structural properties, such as the radial distribution 
function g'(r), based on the particle locations (Sec. 7.4). 

Since SSF Refinement is more complex than centroiding, it requires more 
processing time, by up to an order of magnitude. However, the analysis can 
still reasonably be performed using routines which were written in the IDL 
programming language without particular attention to efficiency, and on a 
typical desktop computer (AMD Athlon 3800-F 2.4Ghz, 2Gb RAM, running 
Windows XP). For a typical image (512 x 512 x 100 voxels, containing about 
6400 particles) and standard parameters (ea;tent=[15.0, 15.0, 13.0], iteration 
grid size 8x=82=^z=1 pixels) around 45 seconds and just over three minutes are 
required for the centroiding and SSF Refinement, respectively. (These times 
include the noise filtering, which has to be done prior to both procedures, 
and in the example given takes around half a minute.) The error analysis, 
which will be described in the following section, is of similar computational 
complexity, but runs more slowly due to the slow routine used for converting 
the value to a probability (Equation 11). 

Despite its advantages. SSF refinement does not wholly overcome the prob- 
lem of close particles (Fig. 20). We consider three cases: First, even if the 
particle location is determined correctly (top) and the SSF (thick line) is thus 
aligned with the particle's image (thin lines), the overlap with the neighbour- 
ing particle leads to a non-zero contribution to (shaded area) in the window 
within which it is calculated (rectange). This is not necessarily important; the 
analysis relies only on x^ having a minimum at the particle location. Second, 
if the particle location, and thus the SSF, is moved away from the neigh- 
bouring particle (left), then the contribution to (shaded area) is increased 
and this location would thus quite rightly be rejected by the SSF refinement 
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procedure. Third, if the particle location is moved closer to the neighbour- 
ing particle (right), compared to the correct location the initially shaded area 
now shrunk while a new shaded area is created on the opposite, left side of the 
SSF. How these two effects balance, and thus how changes, depends on the 
precise shape of the SSF and the particle image. Nevertheless, this illustrates 
that the minimum in might shift toward the neighbouring particle. This is 
similar to the mentioned effect of close particles on the centroiding technique, 
although we expect it to be less significant for the SSF refinement technique. 

There are several possibilities how one could deal with this problem. Knowl- 
edge of the SSF allows us to determine the intensity profile for any set of 
particles and to fit several particle locations simultaneously. However, this is 
computationally very intensive. A less demanding approach would be to use 
on a pixel level and develop a strategy to identify neighbouring particles 
by their anisotropic x^ (shaded areas in Fig. 20) and then either disregard 
these pixels which arc supposedly affected by a neighbouring particle or use 
(the minimum in) their number to determine the particle location. 

l.Jf. Error Analysis 

We showed that contains information on the rehability of each particle 
coordinate. In addition, we can determine the accuracy of the location in an 
arbitrary direction. The shape of the x^ hypersurface reveals how sensitive 
this value is to variations in the fit parameters, and these can be used to infer 
the error in these quantities. 

Recent papers have suggested a means of error determination based on the 
mean variation between a particle's presumed stationary location determined 
in a series of 'identical' image captures [21,98], i.e. precision. In contrast, we 
aim for a measure which is both measured at the single particle level and 
genuinely quantifies accuracy rather than precision. 

First, we consider our expectation for the absolute value of x^- This depends 
not only on the uncertainty in each data point, but also the number of degrees 
of freedom, v; it is usual to define the reduced chi-square value Xr — X^/^- 
This value is expected to take the value Xr — ^ data are described well 

by the model, and the uncertainties (Tx"^y"^z" ^-re representative [96]. 

To obtain an estimate for the errors in the fit parameters, i.e. the particle 
locations, we consider the shape of the x^ hypersurface. There are established 

means of estimating the error in the position of the minimum [96,94,95,97,99,100] 
If we neglect any error in sampling the surface, that is, assume perfect interpo- 
lation, then the error is found from the curvature of the surface. It is customary 
to take the error in a parameter as being the change in its value for which Xr 
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has increased by unity, Ax^=l. This assumes that the experimentally deter- 
mined minimum of Xr is unity, min{x^}=l. If the model is appropriate but 
the noise is unknown, then the condition can be recast: the error in Xr is found 
when it has risen by a value equal to min{x^}, i.e. Ax^=min{x^}. Crucially, 
it is therefore not necessary to estimate the uncertainty in each pixel intensity 
value. Moreover, since Xr ^-re related by the degrees of freedom, u, 

which is constant within a given experiment, we can continue using x^- 

An increase Ax^=min{x^} gives the probability of finding the position be- 
tween the genuine centre and that location of 68.3%, that is, at the one a con- 
fidence level. This follows from the chi-square cumulative distribution [101]: 



Values of F(Ax^;i/) are tabulated in reference [97, §14.5]. 

Using this relation, we can calculate the probability that the particle centre lies 
between the minimum of the x^-hypersurface and any point on that surface, 
i.e. for any Ax^. The x^-hypersurface can therefore be mapped to a probability 
surface. 

A probability distribution created from the x^-hypersurface is shown in fig- 
ure 21 (black curves, left-hand axis) as cuts through a particle in x-, y- and 
^-direction (from top). Also shown (red) is the cumulative probability that 
a particle centre will be found somewhere between the minimum of x^ and 
that location. We can hence infer an error bound; the width of the region of 
the cumulative probability curve which has height less than 0.683, the 'Icr 
point'. It is about 180 nm in the lateral direction, and about 300 nm in axial 
direction. 

We can represent these more informatively. Figure 22 shows the entire par- 
ticle as viewed in the xy-, xz- and yz-planes (top to bottom). The results 
from the centroid procedure are overlain: the centre and an indication of the 
particle size are shown (left, red dot and circle), as well as the particle size as 
determined by light scattering (green circle; both circles centred on centroid 
location). The black grid represents those points where the cumulative proba- 
bility p is greater than the a value {p > 0.683) (the probabilities, according to 
the prescription given above, are calculated on a grid), as this highlights (in 
the middle) the region below the la value, which defines the likely particle lo- 
cation. For clarity, we have extracted the locations which denote the perimeter 
of the gap in the grid, and fitted ellipses through these (right). These represent 
the Icr confidence level for the particle locations. These are not symmetric, in 
particular, they are elongated along the axial direction, as we may have ex- 
pected. Furthermore, although these look believable when compared with the 
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original confocal image (the blue-white background), neighbouring slices also 
contribute to the determined location, making subjective conclusions difficult. 
A series of slices is shown in figure 23; these are cuts through xy-, xz-, and 
l/2;-directions from top to bottom. They are combined in a three-dimensional 
representation in figure 24, which summarizes the results obtained by the SSF 
refinement technique. Ellipses representing the la confidence limit on the par- 
ticle location (right) is compared to the contour surface based on slices through 
the raw image of a particle (left) . 

For comparison we now present the corresponding results for an image of lower 
quality, but similar sample, PMMA spheres with radius 2.18 fim in cis-decalin 
(Figs. 25 - 27). The error bounds calculated based on the surface (Fig. 25) 
are about 360-380 nm in lateral and about 620 nm in axial direction. These 
are about double the values found for the good quality image (Fig. 21). The 
axial uncertainty is determined from one direction only (bottom) , because the 
probability does not rise sufficiently within the window studied (though the 
window size can be increased, care must be taken not to include contributions 
from neighbouring particles). The lower image quality is also refiected in the 
larger regions of likely particle locations, quantified in the la confidence level 
for the particle locations (Figs. 26 and 27), which are significantly larger than 
for the good quality image (Figs. 22 and 23). 

The different curvatures of the x^-hypersurface for the good (Fig. 21) and low 
(Fig. 25) quality image contain the important information which allows us 
to compare the accuracy of the coordinates extracted from similar systems. 
When comparing systems which are optically different (e.g. [7]), a measure 
similar to this one can thus be used. 

On a quantitative level, the error bounds are rather large compared with 
those cited by other studies; about 30-50 nm. The systematic errors probably 
explain this: The error we have quantified above is the inherent error arising 
from the noise, SSF overlap, and other sources of error. However, to assume 
that we can use Ax^ = mm{x^} as the error criterion rather than the usual 
unity is only justified if the data are well-modelled by the SSF. When this 
is not true, the relative increase in is overestimated, and correspondingly 
the error overestimated. In this paper the experimental SSF is determined 
as an average which is necessarily broader than its true form; this certainly 
gives rise to a systematic error. Nonetheless, we feel that the error determined 
as described above is a genuine and informative measure of the error in the 
particle locations. It is indicative of the shape of the confidence contours, and 
gives a compelling comparison of the accuracy between different particles. 

The foregoing analysis was performed without the need for an estimate of ai, 
the error on each pixel's intensity. We can, however, infer what the mean of 
this value must be, supposing the model is correct, i.e. the extracted SSF is 
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representative. For the particle shown in Figures 21-24, the minimum of the 
surface was about 750 per pixeL Neglecting any intensity dependence of cr, 
for example due to photon-counting related noise, this gives an estimate of the 
mean noise in each pixel ol—y/lbQ ~ 27. Figure 28 shows a one-dimensional 
cut through the raw data for the particle shown in Figures 21-24, along with 
an error bar which to the eye is approximately the correct size. Its size is 
27 in total, about half the size implied by the above calculation, revealing as 
expected that systematic errors contribute to the surface. 

The information on the reliability of particle locations is furthermore very 

useful in those cases where it is not necessary to consider all of the particles 
in a sample. Then only those particles can be taken into account which are 
known, via x^, to be reliably located. However, care must be taken when 
discarding information; a discarded particle may be accurately located but 
have a poor x^ value for another reason, for example, if it has a different size. 
There is, for example, a clear improvement m g{r) caused by considering only 
particles with better than a certain x^ value (Fig. 29, showing the same sample 
as on the left in Fig. 15). Since these particles match the SSF best, they must 
both be located to high precision and similar to the expected shape. 

In some cases, it may be of interest to specify an SSF which corresponds to 
a sub-population within the sample, for instance relatively small particles. 
SSF refinement with x^ discrimination would then preferentially select a sub- 
population, in this case by ignoring larger particles. Due to the inherent vari- 
ability in the images of particles, this is realistic only for quite differently-sized 
particle. 

Moreover, we can apply different SSFs representing different shapes or sizes 
of particle and, in particular, one may be interested in replacing the SSF with 
the PSF. We noted earlier the similarity between deconvolution of instances 
of the SSF and those of the PSF. Thinking along these lines suggests using 
the procedure for finding instances of the SSF for locating instances of the 
PSF. If the system under study consists of point-like visible components, then 
the SSF of each is identical to the PSF. In a system matching this descrip- 
tion, for example one comprising particles with a very small fluorescent core, 
the SSFs would not overlap and SSF refinement would be accurate without 
approximation to within the uncertainty of the imaging system. 



8 Conclusion 

Confocal microscopy has become a powerful tool for studying colloidal sys- 
tems, in particular to obtain quantitative information on the level of individual 
particles. Here we have reviewed and extended methods for particle location in 
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colloidal systems with a special emphasis on dense systems. Wc have consid- 
ered the different steps finally leading to reliable particle coordinates and the 
associated errors; from optimum image formation to the initial finding of can- 
didate particle locations and the subsequent refinement by both centroiding 
and SSF refinement, and ultimately to a detailed, novel error analysis which 
provides confidence regions for individual particles. 

Particular emphasis was put on image analysis, where we focused on two 
important methods. First, we reviewed the centroiding technique, which is 
widely used in colloid science [47], but have maintained generality by out- 
lining some other feature location strategies. Second, we have introduced a 
technique previously unreported in colloidal studies: SSF refinement. This not 
only optimises particle coordinates, but also allows for a detailed error analy- 
sis by means of the measure. It permits a quantitative comparison between 
different systems and, furthermore, is sufficiently general to be useful in most 
feature extraction applications. Moreover, we have demonstrated how to lo- 
cate particles reliably, albeit not necessary precisely, under adverse imaging 
conditions, such as dense colloidal suspensions where features may overlap. 
The confidence intervals based on a analysis are instrumental in achieving 
this. 
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Fig. 1. The generic imaging process, comprising a radiating object o{x,y,z), an 
imaging system, T[], and the detected image, f{x',y',z'). 
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Fig. 2. Model of a homogeneously-dyed spherical particle of radius 0.5 /xm 
ispherei^jU, (left), the PSF p(x,y,z) (centre) and the corresponding image 
Smodel{x,y,z) (right). 
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Fig. 3. Simulated intensity profile of a particle with 2 diameter in the lateral 
(left) and axial (right) direction. The true size of the particles (10 pixels) is indicated 
by the dashed lines. The axes are in pixels, with a pixel pitch of 0.2 [im.. 
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Fig. 4. The confocal principle: light originating from within the focal plane (solid 
black) is imaged at the image plane, as in a conventional microscope. Light origi- 
nating outwith the focal plane (dashed red) is not brought to a focus at the image 
plane, and appears as blur in a conventional microscope. A confocal aperture in the 
image plane ensures only a thin optical section is imaged, so that this detrimental 
effect is eliminated by the confocal microscope. 
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Fig. 5. Intensity profile through an undyed PMMA sphere dispersed in an aqueous 
solution of EOSIN Y. 
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Fig. 6. Three sample cell constructions. See text for details. 
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Fig. 7. Images and corresponding histograms to illustrate the effect of offset (top) 
and gain (bottom). The sample contains NBD-dyed PMMA particles with a radius 
of 1.08;um in a mixture of cis-decalin and CHB at a volume fraction of </) = 0.545. 
Tetrabutylammonium chloride has been added to screen the slight charge of the 
particles [41]. The field of view is about AlxAlfim? (256x256 pixels at 0.16/im per 
pixel), and the original image was captured at a rate of about 0.6 fps. 



53 




large peak at - 
maximum intensity 



Grey level 




Fig. 8. Image suffering from saturation, and corresponding histogram. 
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Fig. 9. A good quality but noisy image before (left) and after (right) process- 
ing. Large-scale contrast gradients are not evident in this case. The particle size 
was around 10 pixels, and the corresponding kernel size was w = [11,11,9], and 
Xn = [1, 1, 1]; for details of the parameter choice, see section 6.2. 



55 




Fig. 10. Confocal micrograph (left) and corresponding reconstruction (right) based 
on particle locations. 
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Fig. 11. Two-dimensional slice (top left) and the same image with crosses placed at 
the (nearest pixel to the) detected location. Particles seemingly missed are detected 
in adjacent slices in the sequence (bottom). 
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Fig. 12. Properties characterising particle images: radius of gyration squared of a 
particle versus its total brightness (left) and its peak brightness (right). 
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Fig. 13. Distribution of the fractional part of the particle locations found using the 
centroiding technique. 
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Fig. 14. Effect of parameters on the radial distribution function as obtained by 
determining the particle coordinates using the centroid method. Varied parameters 
are (A) noise filter size, (B) separation, (C) extent, (D) threshold. For values of 
the parameters see text. In each case, the left-hand images are the full rdf, while 
the right-hand ones are 'zoomed in' to a smaller region to more clearly illustrate 
the differences. 
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Fig. 15. Comparison of the radial distribution functions g{r) for a good quality (left) 
and mediocre quality (right) image of two glassy samples of the same system, as 
determined using the centroid procedure. 
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Fig. 16. Effect of overlapping SSFs on the centroid position: particle centres are 
found too close together. The right-hand image is a closer look at the region within 
the rectangle in the left-hand image. The solid black lines represent the individual 
particle SSFs and the red dashed line their sum. 
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Fig. 17. Calculated intensity profiles through two particles in contact, both in lateral 
(left) and axial (right) direction. 
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Fig. 18. Two-dimensional x-z slice through the chi-square hypersurface for a ran- 
domly-chosen particle. 
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Fig. 19. Comparison of the radial distribution functions g{r) as obtained by the 
SSF refinement technique (red circles) and the centroiding method (black triangles) 
respectively. The analysis is based on the same images as in figure 15; a good quality 
(left) and mediocre quality (right) image of two similar glassy samples (of the same 
system, $~0.64). 
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Fig. 20. SSF refinement technique for two neighbouring particles. See text for details. 
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Fig. 21. Variation of nx^/minx^ (black curve, left-hand axis) in the vicinity of its 
minimum, i.e. the most likely particle location, in x-, y- and z-directions (from top). 
The centre of these images correspond to the location determined by the centroid 
analysis. Also shown is the cumulative probability (red, right-hand axis) with the 
inset showing the logarithm of this probability (Importantly, the probability is cal- 
culated using the minimum of the whole surface, which in general differs from the 
minimum through any particular cut). The pixel pitch was laterally 0.16 \xm. and 
axially 0.20 [m\. Furthermore, x^ is only known at integer pixels, while sub-pixel 
values are obtained by a one dimensional polynomial interpolation. 
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Fig. 22. xy-, yz- and xz-slices (from top) through the probabihty distribution, over- 
lain onto the original confocal data (shown as a blue and white background). The 
centre as determined by the centroid analysis is shown as a red point (left), and, 
centred on the point, circles indicating the size of the particle as determined by 
the centroid analysis (red) and dynamic light scattering (green) respectively. The 
black grid represents those points where the probability lies above the la value. The 
locus of points at the la level are represented by ellipses on the right. (See text for 
details.) 
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Fig. 23. Series of xy-, xz- and yz-slices (from left) through the probabihty distribu- 
tion of the same particle as discussed in Figure 22. 
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Fig. 24. Three-dimensional representation of a particle (left) and its error bound 
(right, white ellipses) which represents the la confidence limit on the particle lo- 
cation and thus delimits the region where the particle is most likely found. The 
particle is represented by an isosurface (contour) at greylevel 200. The top images 
show y- and z-slices, while the bottom images show x- and y-slices. 
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Fig. 25. Same information as in Figure 21, but for lower image quality: Variation of 
(black curve, left-hand axis) and cumulative probability (red) in the vicinity of 
the minimum, i.e. the most likely particle location, in x-, y- and z-directions (from 
top). The pixel pitch was laterally 0.13 ^m and axially 0.20 /xm. 
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Fig. 27. Same information as in figure 23, but for a lower quality image. 
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Fig. 28. One-dimensional cut through the original raw data corresponding to the 
particle studied in figures 21-24 (black). Also shown is the same cut through the 
calculated SSF (red), and a suggestive error bar exactly one half the size implied 
by the analysis described in the text. Note that these latter two are aligned with 
the centre of the graph, whereas the real data are sampled at integer locations and 
are therefore necessarily not (though all are nearly aligned). 
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Fig. 29. Radial distribution function g(r) obtained by discarding particles with a 
poor value. 
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